Effects of Education on Differential Item Functioning on the 15-Item Modified Korean Version of the Boston Naming Test
نویسندگان
چکیده
OBJECTIVE Education is expected to have an effect on differential item functioning (DIF) on the 15-item Modified Boston Naming Test in the Korean version of the Consortium to Establish a Registry for Alzheimer's Disease Assessment Packet (BNT-KC). However, no study has examined DIF in the BNT-KC. METHODS We used the item response theory to investigate the impact of education on the DIF in the BNT-KC among elderly individuals with or without dementia (n=720). A two-parameter item response model was used to determine the difficulty and discrimination parameters of each item. The Benjamini-Hochberg procedure was used to address the risk of Type I errors on multiple testing. RESULTS Four items, "mermaid," "acorn," "compass," and "pomegranate" continued to demonstrate DIF after controlling for multiple comparisons. Those with low education levels were more likely to error on "mermaid" and "compass," while those with high education levels were more likely to error on "acorn" and "pomegranate." "Hand" and "red pepper" were too easily identified to be used for detecting dementia patients. "Monk's hat" and "pomegranate" were less discriminating than other items, limiting their usefulness in clinical setting. CONCLUSION These findings may provide useful information for the development of a revised version of the BNT-KC to help clinicians make diagnostic decisions more accurately.
منابع مشابه
A confirmatory study of Differential Item Functioning on EFL reading comprehension
The present study aimed at investigating DIF sources on an EFL reading comprehension test. Accordingly, 2 DIF detection methods, logistic regression (LR) and item response theory (IRT), were used to flag emergent DIF of 203 (110 females & 93 males) Iranian EFL examinees’ performance on a reading comprehension test. Seven hypothetical DIF sources were examin...
متن کاملDifferential Item Functioning (DIF) in Terms of Gender in the Reading Comprehension Subtest of a High-Stakes Test
Validation is an important enterprise especially when a test is a high stakes one. Demographic variables like gender and field of study can affect test results and interpretations. Differential Item Functioning (DIF) is a way to make sure that a test does not favor one group of test takers over the others. This study investigated DIF in terms of gender in the reading comprehension subtest (35 i...
متن کاملSelecting the Best Fit Model in Cognitive Diagnostic Assessment: Differential Item Functioning Detection in the Reading Comprehension of the PhD Nationwide Admission Test
This study was an attemptto provide detailed information of the strengths and weaknesses of test takers‟ real ability through cognitive diagnostic assessment, and to detect differential item functioning in each test item. The rationale for using CDA was that it estimates an item‟s discrimination power, whereas clas- sical test theory or item response theory depicts between rather within item mu...
متن کاملUsing Multiple-Variable Matching to Identify EFL Ecological Sources of Differential Item Functioning
Context is a vague notion with numerous building blocks making language test scores inferences quite convoluted. This study has made use of a model of item responding that has striven to theorize the contextual infrastructure of differential item functioning (DIF) research and help specify the sources of DIF. Two steps were taken in this research: first, to identify DIF by gender grouping via l...
متن کاملBoston naming test short forms: a comparison of previous forms with new item response theory based forms.
Two new short forms of the Boston Naming Test (BNT) were developed using item response theory (IRT) with data from 206 elderly outpatients. We evaluated the diagnostic ability of 12 short forms among the full sample and in a sub-sample of 69 patients diagnosed with mild Alzheimer's disease (AD) either alone or in combination with vascular dementia (VD). The full BNT (reliability alpha = .90) id...
متن کامل